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(57) Abstract: In a near-instantaneously adaptive joint-detection CDMA-based transceiver used for wireless video telephony a 
method for transmission of a multimedia signal is described, the method comprising: providing a transmitter operable to transmit 
in a plurality of modulation modes varying in bit rate and error resilience between a highest bit rate, lowest error resilience mode 
and a lowest bit rate, highest error resilience mode; obtaining a channel quality measure for current transmission; and switching to a 
more or less error resilient modulation mode each time the channel quality measure respectively degrades or improves by a defined 
amount, whereby multimedia signal quality varies smoothly with varying channel quality of the transmission medium. 
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ADAPTIVE JOINT-DETECTION COMA VIDEO TRANSCEIVER 



♦ 1 Background of the Invention 

$ The invention relates to burst-by-burst adaptive joint-detection Code Division Multiple Access (CDMA) 

s based transmission of multimedia signals, such as interactive video or audio, speech etc. 

; In contrast to the bursuby-burst reconfigurable CDMA multimedia transceivers described in this doc- 

s ument, the term statically reconfigurable found in this context in the literature refers to multimedia 

9 transceivers that cannot be near-instantaneously reconfigured. More explicitly, the previously proposed 

10 statically reconfigurable video transceivers were reconfigured on a long-term basis under the base sta- 
ll tion's control, invoking for example in the central cell region - where benign channel conditions prevail 
u • a less robust, but high-throughput modulation mode, such as 4 bit/symbol Quadrature Amplitude Mod- 
i3 ulation (16QAM), which was capable of transmitting a quadruple number of bits and hence ensured a 
N better video quality. By contrast, a robust, but low-throughput modulation mode, such as 1 bit/symbol 
is Binary Phase Shift Keying (BPSK) can be employed near the edge of the propagation cell, where hostile 
is propagation conditions prevail. This prevented a premature hand-over at the cost of a reduced video 
17 quality. 

tB The philosophy of the fixed, but programable-rate proprietary video codecs and statically reconfigurable 

i» multi-mode video transceivers presented by Streit et aL for example in References [1] was that irrespec- 

m tive of the video motion activity experienced, the specially designed video codecs generated a constant 

t\ number of bits per video frame. For example, for videophony over the second-generation Global System 

22 of Mobile Communications known as the GSM system at 13 kbps and assuming a video scanning rate of 

23 10 frames/s, 1300 bits per video frame have to be generated. Specifically, two families of video codecs 

24 were designed, one refraining from using error-sensitive nin-length coding techniques and exhibiting the 
29 highest possible error resilience and another, aiming for the highest possible compression ratio. This 
28 fixed-rate approach had the advantage of requiring no adaptive feedback controlled bitrate fluctuation 
a? smoothing buffering and hence exhibited no objectionable video latency or delay. Furthermore, these 

28 video codecs were amenable to video telephony over fixed-rate second-generation mobile radio systems, 

29 such as the GSM. 

30 The fixed bitrate of the above proprietary video codecs is in contrast to existing standard video codecs. 
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31 such as the Motion Pictures Expert Group codecs known as MPEG I and MPEG2 or the ITU's H.263 

02 codec, where the time-variant video motion activity and the van able- length coding techniques employed 

i3 result in a time-variant bitrate fluctuation and a near-constant perceptual video quality. This time-variant 

34 bitrate fluctuation can be mitigated by employing adaptive feed-back controlled buffering, which po- 

35 tentially increases the latency or delay of the codec and hence it is often objectionable for example in 

36 interactive videophony. The schemes presented by Streit et ai in References [I] result in slightly variable 

37 video quality at a constant bitrate, while refraining from employing buffering, which again, would result 

38 in latency in interactive videophony. A range of techniques, which can be invoked, in order to render the 

39 family of variable- length coded, highly bandwidth-efficient, but potentially error-sensitive class of stan- 

40 dard video codecs, such as the H.263 arrangement, amenable to error-resilient, low-latency interactive 

41 wireless multimode videophony was summarised in [2], The adaptive video rate control and packetisa- 
4j tion algorithm of [2] generates the required number of bits for the burst-by-burst adaptive transceiver, 
« depending the on the capacity of the current packet, as determined by the current modem mode. Fur- 
4* ther error-resilient H.263-based schemes were contrived for example by Fiirber, Steinbach and Girod 
4$ at Erlangen University [3], while Sadka, Eryurtlu and Kondoz (4] from Surrey University proposed a 

46 range of improvements to the H.263 scheme. Following the above portrayal of the prior art in both video 

47 compression and statically reconfigurable narroband modulation, let us now consider the philosophy of 

48 wideband burst-by-burst adaptive quadrature amplitude modulation (AQAM) in more depth. 

4» In burst-by-burst adaptive modulation a higher-order modulation scheme is invoked, when the channel 

m is favourable, in order to increase the system's bits per symbol capacity and conversely, a more robust 

si lower order modulation scheme is employed, when the channel exhibits inferior channel quality, in order 

si to improve the mean Bit Error Ratio (BER) performance. A practical scenario, where adaptive modular 

a tion can be applied is, when a reliable, low-delay feedback path is created between the transmitter and 

S4 receiver, for example by superimposing the estimated channel quality perceived by the receiver on the 

s$ reverse-direction messages of a duplex interactive channel. The transmitter then adjusts its modem mode 

$« according to this perceived channel quality. 

57 Recent developments in adaptive modulation over a narrow-band channel environment have been pi- 
ss oneered by Webb and Steele [3], where the modulation adaptation was utilized in a Digital European 
59 Cordless Telephone - like (DECT) system. The concept of variable rate adaptive modulation was also 
eo advanced by Sampei et al [6], showing promising advantages, when compared to fixed modulation in 
si terms of spectral efficiency, BER performance and robustness against channel delay spread. In another 
62 paper, the numerical upper bound performance of adaptive modulation in a slow Rayleigh flat-fading 
m channel was evaluated by Torrance et al[l] and subsequently, the optimization of the switching threshold 
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«* levels using Powell minimization was used in order to achieve a targeted performance [8. 9]. In addition. 

65 adaptive modulation was also studied in conjunction with channel coding and power control techniques 

66 by Matsuoka et al [6] as well as Goldsmith et ai [10J. 

67 In the narrow-band channel environment, the quality of the channel was determined by the short term 
6» Signal to Noise Ratio (SNR) of the received burst, which was then used as a criterion in order to choose 

69 the appropriate modulation mode for the transmitter, based on a list of switching threshold levels, l n [5 t 9], 

70 However, in a wideband environment, this criterion is not an accurate measure forjudging the quality of 
7t the channel, where the existence of multi-path components produces not only power attenuation of the 
72 transmission burst, but also intersymbol interference. Subsequently, a new criterion has to be defined to 
n estimate the wideband channel quality in order to choose the appropriate modulation scheme. 

74 2 Summary of the Invention 

75 Particular and preferred aspects of the invention are set out in the accompanying independent and depen- 

76 dent claims. Features of the dependent claims may be combined with those of the independent claims as 
n appropriate and used in combinations other than those explicitly set out in the claims. 

78 The performance benefits of burst-by-burst adaptive modulation assisted CDMA are described, employ- 

79 ing a higher-order modulation mode in transmission bursts, when the instantaneous channel quality is 
so favourable, ie when the received signal is unimpaired by co-channel interferers. This procedure is em- 
si ployed, in order to increase the system's bits per symbol (BPS) capacity and conversely, invoking a more 
as robust, lower order modulation mode, when the channel exhibits inferior channel quality. Therefore the 
n associated bit rate will be time-variant 

• It is shown that due to the described adaptive modem mode switching regime a seamless multimedia 
as source-signal representation quality - such as video or audio quality - versus channel quality relation- 
88 ship can be established, resulting in a near-unimpaired multimedia source-signal quality right across 
67 the operating channel Signal-to-Noise Ratio (SNR) range. The main advantage of the described tech- 
ao nique is that irrespective of the prevailing channel conditions, the transceiver achieves always the best 
69 possible source-signal representation quality - such as video or audio quality - by automatically adjust- 
so ing the achievable bitrate and the associated multimedia source-signal representation quality in order to 
si match the channel quality experienced. This can achieved on a near-instantaneous basis under given 

92 propagation conditions in order to cater for the effects of path-loss, fast-fading, slow-fading, dispersion, 

93 co-channel interference, etc. Furthermore, when a mobile is roaming in a hostile out-doors - or even 

94 hilly terrain - propagation environment, typically low-order, low-rate modem modes are invoked, while 
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95 in benign indoor environments predominantly the high-rate, high source-signal representation quality 

96 modes are employed. 

9r 3 Brief Description of the Drawings 

9« For a better understanding of the invention and to show how the same may be carried into effect reference 

99 is now made by way of example to the accompanying drawings, in which: 

100 List of Figures 

•oi I Signalling scenarios in adaptive modems 19 

i2 2 Reconfigurable transceiver schematic 20 

.03 3 Transmission burst structure of the FMA1 spread speech/data mode 2 of the FRAMES 

to* proposalfll] 20 

io5 4 Normalized channel impulse response for the COST 207 seven-path Bad Urban channel. 21 

to* 5 BER versus channel SNR 4QAM performance using BCH coded 13.7Kbps video, com- 

io7 paring the performance of matched filtering and joint detection for 2-8 users 21 

toe 6 BER versus channel SNR 4QAM performance using turbo-coded 1 i. 1Kbps video, corn- 
too paring the performance of matched filtering and joint detection for 2-8 users 22 

no 7 Video packet loss ratio versus channel SNR for the turbo-coded 11.1 Kbps video stream, 

m comparing the performance of matched filtering and joint detection for 2-8 users 22 

112 8 Video packet loss ratio (PLR) and feedback error ratio (FBER) versus channel SNR for 

Hi the three modulation schemes of the 2-user multi-mode system using joint detection, . . 23 

H4 9 Decoded video quality (PSNR) versus channel SNR for the modulation modes of BPSK, 

i» 4QAM and 16QAM supporting 2-users with the aid of joint detection. These results 

ue were recorded for the Miss-America video sequence at SQCIF resolution ( 128x96 pels). 23 

117 10 Decoded video quality (PSNR) versus video packet loss ratio for the modulation modes 

"a of BPSK, 4QAM and 16QAM, supporting 2-users with the aid of joint detection. The 

i is results were recorded for the Miss-America video sequence at SQCIF resolution ( 1 28x96 

120 pels) 24 

121 1 1 Example of modem mode switching in a dynamically reconfigured burst-by-burst mo- 
>22 dem in operation, where the modulation mode switching is based upon the SINR estimate 

123 at the output of the joint-detector. 24 



WO 00/72496 



PCT/GB00/01889 



124 12 PDF of the various adaptive modem modes versus channel SNR 25 

125 13 Throughput bitrate versus channel SNRcomparision of the three fixed modulation modes 
m (BPSK, 4QAM. 16QAM) and the adaptive burst-by-burst modem (AQAM), both sup- 

porting 2 users with the aid of joint detection 25 

.28 14 Average decoded video quality (PSNR) versus channel SNR comparison of the fixed 

i2« modulation modes of BPSK, 4QAM and 16QAM, and the burst-by-burst adaptive mo- 

im dem. Both supporting 2-users with the aid of joint detection. These results were recorded 

'3i for the Miss-America video sequence at SQCIF resolution (128x96 pels) 26 

t32 15 Video packet loss ratio (PLR) versus channel SNR for the three modulation schemes of 

iM the multi-mode system, compared to the burst-by-burst adaptive modem. Both systems 

iw substain 2-users using joint detection 26 

.J3 16 Decoded video quality (PSNR) versus video packet loss ratio comparision of the fixed 

i3« modulation modes of BPSK, 4QAM and 16QAM, and the burst-by-burst adaptive mo- 

137 dem. Both supporting 2-users with the aid of joint detection. These results were recorded 

138 for the Miss- America video sequence at SQCIF resolution (128x96 pels) 27 
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•39 3.1 State-of-the-art 

1*0 Burst-by-burst adaptive quadrature amplitude modulation (AQAM) was contrived by Steele and Webb [5], 
m in order for the transceiver to cope with the time-variant channel quality of narrowband fading channels. 
«4 2 Further related research was conducted at the University of Osaka by Sampei and his colleagues, investi- 
i« gating variable coding rate concatenated coded schemes [6], at the University of Stanford by Goldsmith 
144 and her team, studying the effects of variable-rate, variable-power arrangements [10] and at Southamp- 
u5 ton University in the UK, investigating a variety of practical aspects of AQAM [12, 13]. The channel's 

i4« quality is estimated on a burst-by-burst basis and the most appropriate modulation mode is selected in or- 

u7 der to maintain the required target bit error rate (BER) performance, whilst maximizing the system's Bit 

<*a Per Symbol (BPS) throughput. Using this reconfiguration regime the distribution of channel errors be- 

49 comes typically less bursty, than in conjunction with non-adaptive modems, which potentially increases 

.jo the channel coding gains. Furthermore, the soft-decision channel codec metrics can be also invoked in 

lsi estimating the instantaneous channel quality, irrespective of the type of channel impairments. 

i52 A range of coded AQAM schemes were analysed by Matsuoka et al [6], Lau et al [14] and Gold- 

»53 smith et al [10]. For data transmission systems, which do not necessarily require a low transmission 

154 delay, variable-throughput adaptive schemes can be devised, which operate efficiently in conjunction 

155 with powerful error correction codecs, such as long block length turbo codes. However, the acceptable 
is« turbo interleaving delay is rather low in the context of low-delay interactive speech. Video communica- 
157 tions systems typically require a higher bitrate than speech systems and hence they can afford a higher 
isa interleaving delay. 

159 The above principles - which were typically investigated in the context of narrowband modems - were 

„i6o further advanced in conjunction with wideband modems, employing powerful block turbo coded wide- 

iei band Decision Feedback Equaliser (DFE) assisted AQAM transceivers [15]. A neural-network Radial 

i« Basis Function (RBF) DFE based AQAM modem design was proposed in [16], where the RBF DFE 

isa provided the channel quality estimates for the modem mode switching regime. This modem was capa- 

im ble of removing the residual BER of conventional DFEs, when linearly non-separable received phasor 

its constellations were encountered. 

isa The above burst-by-burst adaptive principles can also be extended to Adaptive Orthogonal Frequency 

tar Division Multiplexing (AOFDM) schemes [17). The associated AQAM principles were invoked in the 

isa context of parallel AOFDM modems also by Czylwik et al [18], Fischer [19] and Chow et al [20]. 

tea Our main contribution is that upon invoking the technique advocated - irrespective of the channel con- 

170 ditions experienced - the transceiver achieves always the best possible video quality by automatically 
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m adjusting the achievable bitrate and the associated video quality in order to match the channel quality ex- 

i72 perienced. This is achieved on a near-instantaneous basis under given propagation conditions in order to 

i7j cater for the effects of path-loss, fast-fading, slow-fading, dispersion, co-channel interference, etc. Fur- 

m thermore, when the mobile is roaming in a hostile outdoor propagation environment, typically low-order. 

t7s low-rate modem modes are invoiced, while in benign indoor environments predominantly the high-rate, 

its high source-signal representation quality modes are employed. 

in 3.2 ACDMA Signalling Scenarios 

•78 ACDMA transmission parameter adaptation is an action of the transmitter in response to time-varying 

its channel conditions. It is only suitable for duplex communication between two stations, since the trans- 

i8o mission parameter adaptation relies on some form of channel estimation and signalling. In order to 

iat efficiently react to the changes in channel quality, the following steps have to be taken: 



tM • Channel quality estimation: In order to appropriately select the transmission parameters to be 

i83 employed for the next transmission, a reliable prediction of the channel quality during the next 

ib4 active transmit timeslot is necessary. 

IBs • Choice of the appropriate parameters for the next transmission: Based on the prediction of the 

las expected channel conditions during the next timeslot, the transmitter has to select the appropriate 

187 modulation schemes for the subcarriers. 

188 • Signalling or blind detection of the employed parameters: The receiver has to be informed, as 
»89 to which set of demodulator parameters to employ for the received packet This information can 

190 either be conveyed within the packet, at the cost of loss of useful data bandwidth, or the receiver 

191 can attempt to estimate the parameters employed at the transmitter by means of blind detection 

192 mechanisms. 



193 Depending on the channel characteristics, these operations can be performed at either of the duplex 

194 stations, as shown in Figures 1(a), 1(b) and 1(c), If the channel is reciprocal, then the channel quality 
i9s estimation for each link can be extracted from the reverse link, and we refer to this regime as open- 
198 loop adaptation. In this case, the transmitter needs to communicate the transmission parameter set to 

197 the receiver (Figure 1(a)), or the receiver can attempt blind detection of the transmission parameters 

198 employed (Figure 1(c)). 

199 If the channel is not reciprocal, then the channel quality estimation has to be performed at the receiver 

200 of the link. In this case, the channel quality measure or the set of requested transmission parameters is 
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jot communicated to the transmitter in the reverse link (Figure 1(b)). This mode is referred to as closed-loop 

202 adaptation. 

2t» 3.3 Video Transceiver 

204 The schematic of the whole system is depicted in Figure 2. The multimedia source signal generated by 

20$ the video encoder of Figure 2 is assembled into transmission packets constituting a CDMA transmission 

2oe burst and the bits may be additionally mapped by the Mapper of Figure 2 to n number of different 

jot Forward Error Correction (FEC) protection classes. These bits axe then convenveyed to the optional 

206 Time Division Multiplex (TDMA)/ Time Division Duplex (TDD) scheme of Figure 2, before they are 

209 assigned to the AQAM/ACDMA modem seen in Figure 2. 

. 210 Again, the philosophy of the proposed burst-by-burst adaptive joint detection CDMA scheme is that the 

' iu signal to interference plus noise ratio (SINR) at the output of the multi-user receiver is used in order to 

2t2 estimate the instantaneous channel quality. In one of its possible embodiments the receiver then decides 

213 on the transmitter's mode to be used during the next transmission burst on the basis of the received signal 

2t4 quality and the receiver's perception of the channel quality is signalled to the remote transmitter, in order 

215 to allow it to satisfy the receiver's integrity requirement. 

2i« In this study we transmitted 176x144 pixel Quarter Common Intermediate Format (QCEF) and 128x96 

2ir pixel Sub-QCIF (SQCIF) video sequences at 10 frames/s using a reconfigurable Time Division Multiple 

2ib Access / Code Division Multiple Access (TDMA / CDMA) transceiver, which can be configured as a I, 

219 2 or 4 bit/symbol scheme shown in Figure 2. The H.263 video codec exhibits an impressive compression 

220 ratio, although this is achieved at the cost of a high vulnerability to transmission errors, since a run-length 

221 coded stream is rendered undecodable by a single bit error. In order to mitigate this problem, when the 
n channel codec protecting the video stream is overwhelmed by the transmission errors, we refrain from 

223 decoding the corrupted video packet in order to prevent error propagation through the reconstructed video 

224 frame buffer [21 . We found that it was more beneficial in video quality terms, if these corrupted video 
22s packets were dropped and the reconstructed frame buffer was not updated, until the next video packet 

226 replenishing the specific video frame area was received. The associated video performance degradation 

227 was found perceptually unobjectionable for packet dropping- or transmission frame error rates (FER) 

228 below about 5%. These packet dropping events were signalled to the remote decoder by superimposing 

229 a strongly protected one-bit packet acknowledgement flag on the reverse-direction packet, as outlined 

230 in [2], Bose-Chaudhuri-Hocquenghem (BCH) and turbo error correction codes were used and again, 

231 the CDMA transceiver was capable of transmitting 1, 2 and 4 bits per symbol, where each symbol was 

232 spread using a low spreading factor (SF) of 16, as seen in Table 1. 
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Parameter 




Multiple access 


TD MA/CDMA 


Channel type 


COST 207 Bad Urban 


Number of paths in channel 


7 


Normalised Doppler frequency 


3.7 x 10~ 5 


CDMA spreading factor 


16 


Spreading sequence 


Random 


Frame duration 


4.615 ms 


Burst duration 


577 ps 


Joint detection CDMA receiver 


Whitening matched filter (WMF) or Minimum 
mean square error block decision feedback 
equalizer (MMSE-BDFE) 


No. of Slots/Frame 


8 


TDMA frame length 


4.615ms 


TDMA slot length 


577/is 


TDMA slots/Video packet 


3 


Chip Periods/TDMA slot 


1250 


Data Symbols/TDMA slot 


68 


User Data Symbol Rate (kBd) 


14.7 


System Data Symbol Rate (kBd) 


117.9 



Table i: Generic system parameters using the Frames spread speech/data mode 2 proposal [11] 



The associated parameters will be addressed in more depth during our further discourse. Employing 

234 a low spreading factor of 16 allowed us to improve the system's multi-user performance with the aid 

las of joint-detection techniques [21]. We note furthermore that the implementation of the joint detection 

2» receivers is independent of the number of bits per symbol associated with the modulation mode used, 

237 since the receiver simply inverts the associated system matrix and invokes a decision concerning the 

238 received symbol, irrespective of how many bits per symbol were used Therefore, joint detection 

239 receivers are amenable to amalgamation with the above 1, 2 and 4 bit/symbol modem, since they 

240 do not have to be reconfigured each time the modulation mode Is switched. 

2«i In this performance study we used the Pan-European FRAMES proposal [1 1] as the basis for our CDMA 

242 system. The associated transmission frame structure is shown in Figure 3, while a range of generic system 
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Features 


BCH coding 


Turbo coding 


Modulation 


4QAM 


Transmission bitrate (kbit/s) 


29.5 


Video-rate (kbit/s) 


13.7 


ll.l 


Video framerate (Hz) 


10 



Table 2: FEC-protected and unprotected BCH and Turbo coded bitrates for the 4QAJ4 transceiver mode 

a« parameters are summarised in Table 1. In our performance studies we used the COST207 seven-path bad 

2M urban (BU) channel model, whose impulse response is portrayed in Figure 4. 

24$ Our initial experiments compared the performance of a whitening matched filter (WMF) for single user 

24« detection and the Minimum mean square error block decision feedback equalizer (MMSE-BDFE) for 

a* joint multi-user detection. These simulations were performed using 4-level Quadrature Amplitude Mod- 

248 ulation (4QAM), transmitting both binary BCH and turbo coded video packets. The associated bitrates 

249 are summarised in Table 2. 

2so The transmission bitrate of the 4QAM modem mode was 29.5Kbps, which was reduced due to the ap- 

2si proximately half-rate BCH or turbo coding, plus the associated video packet acknowledgement feedback 

252 flag error control and video packetisation overhead to produce effective video bitrates of 13.7Kbps and 

253 1 1 . 1Kbps, respectively. A more detailed discussion on the video packet acknowledgement feedback 

254 error control and video packetisation overhead will be provided in Section 3.4 with reference to the 

255 convolutionally coded multi-mode investigations. 

2M Figure 5 portrays the bit error ratio (BER) performance of the BCH coded video transceiver using both 

257 matched filtering and joint detection for 2-8 users. The bit error ratio is shown to increase, as the number 

sj§ of users increases, even upon employing the MMSE-BDFE multi-user detector (MUD). However, while 

259 the matched filtering receiver exhibits an unacceptable high BER for supporting perceptually unimpaired 

aw video communications, the MUD exhibits a far superior BER performance. 

28i When the BCH codec was replaced by the turbo-codec, the bit error ratio performance of both matched 

2«2 filtering and the MUD receiver improved, as shown in Figure 6. However, as expected, matched filtering 

253 was still outperformed by the joint detection scheme for the same number of users. Furthermore, the 

2M matched filtering performance degraded rapidly for more than two users. 

265 Figure 7 shows the video packet loss ratio (PLR) for the turbo coded video stream using matched filtering 

266 and joint detection for 2-8 users. The figure clearly shows that the matched filter was only capable of 

267 meeting the target packet loss ratio of 5% for upto four users, when the channel SNR was in excess of 
266 1 IdB. However, the joint detection algorithm guaranteed the required video packet loss ratio performance 

10 
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Features 


Multi-rate System 


Mode 


BPSK 


4QAM 


16QAM 


Bits/Symbol 


1 


2 


4 


FEC 


Convolution^ Coding 


Transmitted bits/packet 


204 


408 


816 


Total bitrate (kbit/s) 


14.7 


29.5 


58.9 


FEC-coded bits/packet 


102 


204 


408 


Assigned to FEC-coding (kbit/s) 


7.4 


14.7 


29.5 


Error detection per packet 


l6bitCRC 


Feedback bits / packet 


9 


Video packet size 


77 


179 


383 


Packet header bits 


8 


9 


10 


Video bits/packet 


69 


170 


373 


Unprotected video-rate (kbit/s) 


5.0 


12.3 


26.9 


Video framerate (Hz) 


10 



Table 3: Operational-mode specific transceiver parameters for the proposed multi-mode system 

m for 2-8 users in the entire range of channel SNRs shown. Furthermore, the 2-user matched-filtered PLR 
in performance was close to the 8-user MUD PLR. 

m 3.4 Multi-mode Video System Performance 

*n Having shown that joint detection can substantially improve our system's performance, we investigated 

m the performance of a multi-mode convolutionally coded video system employing joint detection, while 

v* supporting two users. The associated convolutional codec parameters are summarised in Table 3. 

vi Below we now detail the video packetisation method employed. The reader is reminded that the number 

J7» of symbols per TDMA frame was 68 according to Table 1. In the 4QAM mode this would give 136 bits 

m per TDMA frame. However, if we transmitted one video packet per TDMA frame, then the packetisation 

m overhead would absorb a large percentage of the available bitrate. Hence we assembled larger video 

m packets, thereby reducing the packetisation overhead and arranged for transmitting the contents of a 

wo video packet over three consecutive TDMA frames, as indicated in Table 1. Therefore each protected 

». video packet consists of 68 x 3 = 204 modulation symbols, yielding a transmission bitrate of between 

m 14.7 and 38.9 Kbps for BPSK and 16QAM. respectively. However, in order to protect the video data 
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c» we employed half-rate, constraint-length nine convolutional coding, using octal generator polynomials 

:m of 561 and 753. The useful video bitrate was further reduced due to the 16-bit Cyclic Redundancy 

Mi Checking (CRC) used for error detection and the nine-bit repetition-coded feedback error flag for the 

w$ reverse link. This results in video packet sizes of 77, 179 and 383 bits for each of the three modulation 

287 modes. The useful video capacity was finally further reduced by the video packet header of between 8 

zee and 10 bits, resulting in useful or effective video bitrates ranging from 5 to 26.9 Kbps in the BPSK and 

289 I6QAM modes, respectively. 

290 The proposed multi-mode system can switch amongst the 1. 2 and 4 bit/symbol modulation schemes 

291 under network control, based upon the prevailing channel conditions. As seen in Table 3. when the 

292 channel is benign, the unprotected video bitrate will be approximately 26.9Kbps the 16QAM mode. 

293 However, as the channel quality degrades, the modem will switch to the BPSK mode of operation, where 
the video bitrate drops to 5Kbps, and for maintaining a reasonable video quality, the video resolution has 

2«s to be reduced to SQCIF ( 1 28x96 pels). 

2os Figure 8 portrays the packet loss ratio for the multi-mode system, in each of its modulation modes for a 

297 range of channel SNRs. It can be seen in the figure that above a channel SNR of l4dB the 16QAM mode 

298 offers an acceptable packet loss ratio of less than 5%, while providing an unprotected video rate of about 

299 26.9Kbps. If the channel SNR drops below l4dB, the multi-mode system is switched to 4QAM and 
aw eventually to BPSK, when the channel SNR is below 9dB, in order to maintain the required quality of 
mi service, which is dictated by the packet loss ratio. The figure also shows the acknowledgement feedback 

302 error ratio (FBER) for a range of channel SNRs, which has to be substantially lower, than the video 

303 PLR itself. This requirement is satisfied in the figure, since the feedback errors only occur at extremely 

304 low channel SNRs, where the packet loss ratio is approximately 50%, and it is therefore assumed that 
a the multi-mode system would have switched to a more robust modulation mode, before the feedback 

306 acknowledgement flag can become comipted. 

w The video quality is commonly measured in terms of the peak-signal-to-noise-ratio (PSNR). Figure 9 

3o« shows the video quality in terms of the PSNR versus the channel SNRs for each of the modulation 

309 modes. As expected, the higher throughput bitrate of the 16QAM mode provides a better video quality. 

310 However, as the channel quality degrades, the video quality of the 16QAM mode is reduced and hence 
3n it becomes beneficial to switch from the 16QAM mode to 4QAM at an SNR of about 14dB, as it was 
312 suggested by the packet loss ratio performance of Figure 8. Although the video quality expressed in 
3.3 terms of PSNR is superior for the 16QAM mode in comparison to the 4QAM mode at channel SNRs 
3h in excess of l2dB, however, due to the excessive PLR the perceived video quality appears inferior in 
3>s comparison to that of the 4QAM mode, even though the 16QAM PSNR is higher for channel SNRs 
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jie in the range of 12-14dB. More specifically, we found that it was beneficial to switch to a more robust 

3i7 modulation scheme, when the PSNR was reduced by about IdB with respect to its unimpaired PSNR 

a«8 value. This ensured that the packet losses did not become subjectively apparent, resulting in a higher 

3.9 perceived video quality and smoother degradation, as the channel quality deteriorated. 

3w The effect of packet losses on the video quality quantified in terms of PSNR is portrayed in Figure 10. 

3ii The figure shows, how the video quality degrades, as the PLR increases. It has been found that in order 

322 to ensure a seamless degradation of video quality as the channel SNR reduced, it was the best policy 

323 to switch to a more robust modulation scheme, when the PLR exceeded 5%. The figure clearly shows 

324 that a 5% packet loss ratio results in a loss of PSNR, when switching to a more robust modulation 

325 scheme. However, if the system did not switch until the PSNR of the more robust modulation mode 

326 was similar, the perceived video quality associated with the originally higher rate, but channel-impaired 
m stream became inferior. 

3.5 Burst-by-Burst adaptive videophone system 

329 A burst-by-burst adaptive modem, maximizes the system's throughtput by using the most appropriate 

330 modulation mode for the current instantaneous channel conditions. Figure 1 1 exemplifies, how a burst- 

331 by-burst adaptive modem changes its modulation modes based on the fluctuating channel conditions. The 

332 adaptive modem uses the SINR estimate at the output of the joint-detector to estimate the instantaneous 

333 channel quality, and hence to set the modulation mode. 

334 The probability of the adaptive modem using each modulation mode for a particular channel SNRs is 
33$ portrayed in Figure 12. It can be seen at high channel SNRs that the modem mainly uses the 16QAM 
336 modulation mode, while at low channel SNRs the BPSK mode is most prevalent. 

,*7 The advantage of dynamically reconfigured burst-by-adaptive modem over the statically switched multi- 

338 mode system previously described, is that the video quality is smoothly degraded as the channel condi- 

339 tions deteriorate. The switched multi-mode system results in more sudden reductions in video quality, 

340 when the modem switches to a more robust modulation mode. Figure 13 shows the throughput bitrate 

341 of the dynamically reconfigured burst-by-burst adaptive modem, compared to the three modes of the 
34j statically switched multi-mode system. The reduction of the fixed modem modes' effective throughput 

343 at low SNRs is due to the fact that under such channel conditions an increased fraction of the transmitted 

344 packets have to be dropped, reducing the effective throughtput. The figure shows the smooth reduction of 
34s the throughput bitrate, as the channel quality deteriorates. The burst-by-burst modem matches the BPSK 
348 mode's bitrate at low channel SNRs, and the 16QAM mode's bitrate at high SNRs. The dynamically 
347 reconfigured burst-by-burst adaptive modem characterised in the figure perfectly estimates the prevalent 
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345 channel conditions although in practice the estimate of channel quality is not perfect and it is inherently 

349 delayed. However, we have found that non-perfect channel estimates result in only slightly reduced 

350 performance, when compared to perfect channel estimation. 

351 The smoothly varying throughput bitrate of the bunt-by-burst adaptive modem translates into a smoothly 
35? varying video quality as the channel conditions change. The video quality measured in terms of the 
aw average peak signal to noise ratio (PSNR) is shown versus the channel SNR in Figure 14 in contrast to 

354 that of the individual modem modes. The figure demonstrates that the burst-by-burst adaptive modem 

355 provides equal or better video quality over a large proportion pf the SNR range shown than the individual 
35« modes. However, even at channel SNRs, where the adaptive modem has a slightly reduced PSNR, the 
357 perceived video quality of the adaptive modem is better since the video packet loss rate is far lower, than 
35» that of the fixed modem modes. 

Figure 15 shows the video packet loss ratio versus channel SNR for the three fixed modulation modes 

360 and the burst-by-burst adaptive modem with perfect channel estimation. Again the figure demonstrates 

3ei that the video packet loss ratio of the adaptive modem is similar to that of the fixed BPSK modem mode, 

362 however the adaptive modem has a far higher bitrate throughput, as the channel SNR increases. The 

sea burst-by-burst adaptive modem gives an error performance similar to that of the BPSK mode, but with 

3«« the flexibity to increase the bitrate throughput of the modem, when the channel conditions improve. If 

aes imperfect channel estimation is used, the throughput bitrate of the adaptive modem is reduced slightly. 

3M Furthermore, the video packet loss ratio seen in Figure 15 is slightly higher for the AQAM scheme due 

3«7 to invoicing higher-order modem modes, as the channel quality increases. However we have found that 

36a is possible to maintain the video packet loss ratio within tolerable limits for the range of channel SNRs 

369 considered. 

o The interaction between the video quality measured in terms of PSNR and the video packet loss ratio 

art can be more clearly seen in Figure 16. The figure shows that the adaptive modem slowly degrades 

an the decoded video quality from that of the error free 16QAM fixed modulation mode, as the channel 

an conditions deteriorate. The video quality degrades from the error-free 4idB PSNR, while maintaining a 

374 near-zero video packet loss ratio, until the PSNR drops below about 36dB PSNR. At this point the further 

37$ reduced channel quality inflicts an increased video packet loss rate and the video quality degrades more 

37e slowly. The PSNR versus packet loss ratio performance then tends toward that achieved by the fixed 

377 BPSK modulation mode. However the adaptive modem achieved better video quality than the fixed 

37a BPSK modem even at high packet loss rates. 
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DTD 3.6 Summary 

380 A joint-detection assisted multimode CDMA-based video transceiver was proposed, which substantially 

mi outperformed the conventional matched-filtering based transceiver, which was characterised by adap- 

3« tively reconfiguring the transceiver's mode of operation based on the instantaneous channel quality. In 

w our transceiver a higher number of bits per modulation symbol was invoked by the transmitter, when 

384 the channel quality was sufficiently high for supporting this more bitrate efficient, but less error resilient 

38s transmission mode. By contrast, a more error resilient but less bitrate efficient mode was invoked for 

38« supporting error-free CDMA transmission over wireless multi-user channels. 

387 In this embodiment the above property was exploited in a practical adaptive video transceiver, which 

388 instructed the video codec to generate the required number of bits that the CDMA transceiver was capable 
Ms of delivering in its current channel-condition dependent configuration mode. 

ago In other embodiments the proposed burst-by-burst adaptive transceiver can be invoked in the context 

39i of arbitrary multimedia signals, irrespective of their resolution or source representation quality. Spe- 

39i cific further embodiments of such codecs are constituted by programmable-rate speech, audio, video, 

393 handwriting codecs, which can be configured by the transceiver to generate a channel-quality dependent 

394 number of source-coded bits. 

395 The proposed burst-by-burst adaptive video transceiver guaranteed a near-unimpaired video quality for 
398 channel SNRs in excess of about 5 dB over the COST207 dispersive Rayleigh-faded channel. The ben- 

397 efits of the multimode video transceiver clearly manifest themselves in terms of supporting un-impaired 

398 video quality under time-variant channel conditions, where a single-mode transceiver's quality would 

399 become severely degraded by channel effects. The dynamically reconfigured burst-by-burst adaptive 

400 modem gave better perceived video quality due to its more graceful reduction in video quality, as the 
l-oi channel conditions degraded, than a statically switched multi-mode system. 
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CLAIMS 

1. A method for CDMA transmission of a multimedia signal over a transmission 
medium, the method comprising: 

providing a transmitter operable to transmit in a plurality of modulation modes 
5 varying in bit rate and error resilience between a highest bit rate, lowest error 
resilience mode and a lowest bit rate, highest error resilience mode; 

obtaining a channel quality measure for current transmission; and 
switching to a more or less error resilient modulation mode each time the 
channel quality measure respectively degrades or improves by a defined amount, 
1 0 whereby multimedia signal quality varies smoothly with varying channel quality of the 
transmission medium. 

2. A method according to claim 1, wherein the channel quality measure is a 
multimedia signal quality dependent signal-to-noise value. 

15 

3. A method according to claim 2, wherein the defined amount is set with 
reference to an unimpaired signal-to-noise value. 

4. A method according to claim 2 or 3, wherein the signal-to-noise value is a peak 
20 signal-to-noise ratio for a multimedia video signal. 

5. A method according to claim 2 or 3, wherein the signal-to-noise value is a 
segmental signal-to-noise ratio for a multimedia speech signal. 

25 6. A method according to claim 1, wherein the channel quality measure is a 
packet loss value. 

7. A method according to claim 1, wherein the packet loss value is varied 
dependent upon desired multimedia signal quality. 

30 
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8. A method according to claim 1, wherein the channel quality measure is a bit 
error rate. 

9. A method according to any one of claims 1 to 8, wherein the channel quality 
5 measure is based on monitoring signal integrity at a remote receiver. 

10. A method according to any one of claims 1 to 8, wherein the channel quality 
measure is based on monitoring signal integrity at a receiver local to the transmitter. 

10 11. A transmitter for transmission of a multimedia source signal over a 
transmission medium to a remote receiver, the transmitter comprising a CDMA 
modem having an output for transmitting a multimedia source signal and an input for 
receiving a channel quality measure for current transmission, wherein the CDMA 
modem is switchable between a plurality of modulation modes varying in bit rate and 

1 5 error resilience between a highest bit rate, lowest error resilience mode and a lowest bit 
rate, highest error resilience mode, such that the CDMA modem is switched to a more 
or less error resilient modulation mode each time the channel quality measure 
respectively degrades or improves by a defined amount, whereby multimedia signal 
quality is smoothly variable with varying channel quality of the transmission medium. 

20 

12. A transmitter according to claim 11, wherein the channel quality measure is a 
multimedia signal quality dependent signal-to-noise value. 

13. A transmitter according to claim 12, wherein the defined amount is set with 
25 reference to an unimpaired signal-to-noise value. 

14. A transmitter according to claim 12 or 13, wherein the signal-to-noise value is 
a peak signal-to-noise ratio for a multimedia video signal. 

30 15. A transmitter according to claim 12 or 13, wherein the signal-to-noise value is 
a segmental signal-to-noise ratio for a multimedia speech signal. 
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16. A transmitter according to claim 1 1, wherein the channel quality measure is a 
packet loss value. 

17. A transmitter according to claim 11, wherein the packet loss value is variable 
5 dependent upon desired multimedia signal quality. 

18. A transmitter according to claim 1 1, wherein the channel quality measure is a 
bit error rate. 



10 19. A transmitter according to any one of claims 11 to 18, wherein the channel 
quality measure is based on monitoring signal integrity at a remote receiver. 

20. A transmitter according to any one of claims 11 to 18, wherein the channel 
quality measure is based on monitoring signal integrity at a receiver local to the 
15 transmitter. 



21. A transmission system for transmission of multimedia source signals over a 
transmission medium, the system comprising: 

a first transceiver including a local receiver and a local transmitter according to 
20 any one of claims 1 1 to 20; and 

a second transceiver including a remote receiver and a remote transmitter 
according to any one of claims 1 1 to 20. 
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